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ABSTRACT 

The need to further integrate SoTL into college and university cultures has been 
discussed relatively frequently in recent teaching and learning literature. While 
a number of useful strategies to assist in this task have been advanced, one es¬ 
pecially promising suggestion is the development of organized, institutionally- 
recognized scholarship institutes. Centres or units of this sort have been created at 
higher education institutions in a number of countries, but little published infor¬ 
mation currently exists about the design of these institutes or the experiences of 
individuals affiliated with them.To that end, the present study sought to examine 
the perceived benefits, challenges and design features of teaching and learning 
scholarship institutes at research-intensive universities worldwide. A website 
scan and a survey of individuals affiliated with these units were used to collect 
qualitative and quantitative data of relevance to the research questions. Based 
on the findings, and on ideas from the existing research institute and scholarship 
of teaching and learning literatures, a series of recommendations for individuals 
and campuses interested in developing effective SoTL institutes are provided. 
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In recent years, the need to increase the institutional integration and impact of teach¬ 
ing and learning scholarship has been widely discussed (e.g., Ginsberg & Bernstein, 2011; 
Williams et al., 2013). While—as Hutchings, Huber, and Ciccone (2011) point out—the 
SoTL movement “has made great progress, in many settings it remains a special initiative 
[... ] as yet only unevenly woven into the mainstream of academic life” (p.l). In order 
to fully meet its potential to enhance student learning, however, SoTL must be tightly 
interwoven into institutional fabrics, such that its findings inform teaching and learning 
practices in widespread and meaningful ways. This article reports the findings of research 
designed to assist in such integration. 

The challenges attached to integrating SoTL more fully into institutional cultures 
are many, ranging from confusion about what SoTL is (Boshier, 2009) to heavy academic 
workloads (Brew, 2010) that can dissuade faculty from conducting teaching and learning 
scholarship or even reading it. The undervaluing of teaching and of SoTL must also be 
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navigated (Chalmers, 2011; Walker, Baepler, & Cohen, 2008), insofar as it too decreases 
the likelihood that SoTL will be undertaken or applied, and leaves many scholars who do 
conduct such work feeling isolated within their departments and/or institutions (Mighty, 
2013). Existing literature also describes the difficulties of becoming a SoTL scholar for 
many academics, as doing so often requires constructing a new sense of scholarly identity 
(Galloway & Jones, 2012; Simmons et al., 2013) and/or navigating compelling feelings 
of‘novice-stry’ (Tremonte, 2011) as one begins working in a new field. While it is cer¬ 
tainly not necessary for all academics to engage in SoTL (Dunwoody, Westcott, Drews, 
& Hosier, 2012), such challenges that impede upon the engagement of individual schol¬ 
ars nonetheless bear significantly on the extent to which SoTL gains a foothold on indi¬ 
vidual campuses. 

Varied strategies for negotiating these challenges and developing SoTL have been 
described in the literature. Many SoTL advocates have suggested that teaching and learn¬ 
ing inquiry is more effective when aligned with institutional mission and identity (Good- 
burn & Savory, 2009; Schroeder, 2007), for example, or with established disciplinary 
priorities (Cousin, Healey, Jenkins, Bradbeer, & King, 2003; Dewar & Bennett, 2010; 
Huber & Morreale, 2002). Likewise, others have discussed the importance of mobilizing 
a network of change agents and champions who advocate for SoTL at the institution and 
beyond (McKinney, 2012), including senior administrators and other leaders who can 
affirm that SoTL is an official campus priority (Ginsberg & Bernstein, 2011). Incentives 
such as awards and grants for SoTL work (Mackenzie & Mann, 2009) and meaningful 
professional development opportunities (Martensson, Roxa, & Olsson, 2011) have also 
been described as ways of encouraging and supporting individual teaching and learning 
scholars and contributing to the development of a critical mass. Finally, several scholars 
have argued that a central step in integrating SoTL within institutional cultures is recog¬ 
nizing such work officially within campus tenure and promotion processes (Dunwoody 
et ah, 2012; McConnell, 2012). By including SoTL explicitly within such policies, the 
argument goes, universities encourage faculty members to invest precious time and en¬ 
ergy into such work and further demonstrate that teaching and learning inquiry is a valid 
type of scholarly endeavour. 

Another strategy gaining some momentum of late is the establishment of formal 
units devoted to conducting teaching and learning inquiry, commonly referred to as SoTL 
‘institutes.’ Like research centres in other fields, SoTL institutes (in the sense of the term 
used in this study) are recognized organizational bodies that typically exist outside of 
a single academic department and focus on the creation of knowledge connected to a 
particular topic—in this case teaching and learning in higher education. This might in¬ 
clude, for example, centralized research units with cross-disciplinary membership, bod¬ 
ies housed within a Faculty or department that work in collaboration with others across 
campus or beyond, or educational development centres with a prominent and active 
focus on conducting SoTL work. 1 Several authors have positioned the establishment of 
such institutionally recognized bodies as a key means of enhancing and institutionaliz¬ 
ing teaching and learning inquiry (e.g., Gale, 2009; Poole, Taylor, & Thompson, 2007), 
sometimes pointing out that they can provide a useful framework for actualizing some 
of the strategies described above. Literature discussing organized research units in other 
fields also emphasizes additional benefits that attach to these units, including support 
for interdisciplinarity (Sa, 2007) and for collaborative scholarship (Boardman & Corley, 
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2008)—priorities that have also been established for SoTL (McKinney, 2013, Macken¬ 
zie & Meyers, 2012). Nonetheless, with few exceptions (e.g., Hubball, Clarke, & Poole, 
2010), there exists little published information about the effective design and manage¬ 
ment of SoTL institutes specifically, nor about the experiences of scholars affiliated with 
these bodies. Indeed, as the examples above suggest, there is as yet no widely accepted 
understanding of what defines a SoTL institute, and the kinds of unit that might fall under 
this label are diverse. On one hand, this isn’t surprising, given the comparative youth of 
many existing institutes and the finding that research centres in general are heterogeneous 
and not often thoroughly and proactively designed (Boardman & Corley, 2008). In order 
to maximize the potential efficacy of such units, however, their development must be 
founded on a strong evidence base. 

To begin to address this need, the pilot study reported here examined the perceived 
benefits, challenges, and key design features of organized research units devoted to teach¬ 
ing, learning, or education at research-intensive universities. The goal was not only to de¬ 
termine what such units look like, but also, more centrally, to begin to unpack how indi¬ 
viduals affiliated with SoTL institutes experience these organizational bodies. Qualitative 
and quantitative data were gathered in an attempt to address three research questions: 

1. What are the characteristics of existing educational scholarship institutes at 
research-intensive universities ? 

2. What are the perceived benefits and challenges of these institutes, according to 
institute members and directors ? 

3. W^hat features of institute design do members and directors believe contribute to 
their institutes' successes and challenges ? 

RESEARCH CONTEXT AND METHODOLOGY 

The research reported here was conducted at McMaster University, a medium-sized 
university in Ontario, Canada. In a recent visioning exercise, a campus advisory committee 
defined the institution as a “research-focused, student-centered” university, emphasizing 
that education and research should be productively intertwined and that we must take 
evidence-based approaches to all parts of our campus mission (Forward with Integrity 
Advisory Group, pp. 4-5). As part of reaching this goal, the university established in 2013 
the McMaster Institute for Innovation & Excellence in Teaching & Learning, expanding 
the mandate of its existing teaching and learning centre to enhance the university’s con¬ 
tributions to teaching and learning scholarship. The study reported here was developed to 
contribute to an evidence-informed plan for developing SoTL through this new institute. 

Data were collected via an online survey instrument distributed to institute-affiliated 
personnel. In order to locate relevant potential scholarship units, I examined the catego¬ 
rization of the top 700 universities on the QS World University Rankings list for 2012 
(http://www.topuniversities.com/) and considered all universities that were labeled 
“High” or “Very High” in research intensity and “Comprehensive” or “Fully Comprehen¬ 
sive” in subject focus. This resulted in a new list of 539 universities around the world that 
are roughly similar to McMaster in the areas noted. I then searched websites for these in¬ 
stitutions for references to scholarship units focusing on higher education or on teaching 
and learning in higher education. This search yielded 105 relevant units at 91 universities 
worldwide. Subsequently, I searched the websites for these units for the email addresses 


21 


•••o 


•#*o 


Marquis 


of institute members, directors, and advisory board representatives. Following approval 
from the university Research Ethics Board, 2330 individuals were invited to complete 
an anonymous online survey consisting of both open-ended and Likert-style questions. 

Survey questions asked participants to report on the features and outcomes of their 
teaching and learning scholarship institutes, and on their perceptions of the benefits and 
challenges attached to these institute characteristics. Some questions were adapted from 
the Carnegie Academy for the Scholarship of Teaching and Learning (CASTL) survey 
(http://www.carnegiefoundation.org/resources/tools-sharing). Copies of the full survey 
instrument are available from the author upon request. During the three weeks in which 
the survey was available, responses were received from 215 institute members and 30 
directors/board members (a response rate of ~11% overall). 

Following data collection, basic descriptive statistics were computed for Likert-style 
survey responses, and constant comparison (Merriam, 2009) was used to analyse re¬ 
sponses to the open-ended survey questions. In an initial open-coding phase, relevant 
units of meaning in the qualitative data were noted and highlighted. I then grouped and 
collapsed these into preliminary, higher-order categories and revisited raw responses to 
ensure that this initial code tree was consistent with the data. This process was repeated 
until a final code structure was developed. Unfortunately, due to the limited size of the 
research team, triangulation of interpretation was not possible. Flowever, a rigorous analy¬ 
tical process was followed, and the fact that the resulting findings resonated with the 
quantitative data suggests that the analysis is reasonably valid—particularly for a pilot 
study. 

Given the anonymous nature of the survey, responses were not compared based 
on location or institutional type, as such demographic data were not available. Instead, 
themes and trends were examined as they cut across the responses as a set. The extent to 
which perceptions of SoTL institutes might vary internationally remains a compelling 
question for future research. 

RESULTS 

Perceived benefits 

Survey respondents claimed that membership in an organized scholarship unit had 
a number of individual and institutional benefits, echoing many of the ideas highlighted 
in the literature. In line with the claim that being attached to an organized scholarship 
unit augments scholars’ collaborative networks, for instance, many respondents either 
agreed or strongly agreed that they had “found new colleagues and communities for work 
on teaching and learning” as a result of their participation in the institute on their cam¬ 
pus. Several also suggested that membership in an organized research centre has a posi¬ 
tive impact on scholarly output, agreeing that the quality of their teaching and learning 
inquiry has been enhanced, and/or that they have developed new teaching and learning 
research interests by virtue of being an institute member. Interestingly, a much lower 
percentage of participants agreed or strongly agreed with the assertion that the amount 
of teaching and learning scholarship they produce has increased as a result of their insti¬ 
tute membership, suggesting that the impact of such units on research productivity may 
be related more to perceived quality than to quantity. A complete breakdown of impact 
statements provided in this question and participant responses can be found in Table 1. 
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Table 1. Perceived Impacts of Institute Affiliation 


NUMBER OF RESPONSES BY RANKING 



NUMBER OF 

STRONGLY 



STRONGLY 

UNSURE/ 

AREA OF IMPACT 

RESPONSES 

DISAGREE 

DISAGREE 

AGREE 

AGREE 

NA 

Found new colleagues 
and communities 

181 

4 

18 

67 

84 

8 

Developed new SoTL 
interests 

180 

5 

26 

82 

58 

9 

Heightened interest in 
reading SoTL 

182 

5 

31 

68 

68 

10 

Enhanced SoTL quality 

173 

6 

19 

75 

54 

19 

Contributed to meeting 
institutional priorities 

182 

9 

23 

82 

49 

19 

Changed course design 

178 

10 

33 

67 

49 

19 

Changed teaching 
expectations 

177 

9 

35 

65 

so 

18 

Engaged in inter-depart- 
mental, collaborative SoTL 

177 

7 

40 

58 

54 

18 

Trained new SoTL 
scholars (inc. students) 

170 

14 

26 

62 

45 

23 

Changed expectations 
for students’ learning 

177 

12 

36 

62 

47 

20 

Influenced teaching at 
the university beyond the 
department 

172 

12 

35 

66 

37 

22 

Changed assessments 
used in course 

170 

9 

40 

54 

47 

20 

Influenced teaching in the 
department 

174 

11 

36 

59 

41 

27 

Increased SoTL quantity 

172 

9 

45 

54 

37 

27 

Documented improve¬ 
ments in students’ learning 

169 

9 

45 

52 

34 

29 

Enhanced prospects for 
career advancement 

178 

37 

38 

49 

28 

26 


In responses to an open-ended question, participants reiterated some of these points 
and described other benefits as well. Most notably, a large number of respondents (37%) 
mentioned the way in which belonging to a group of this sort affords individuals valuable 
opportunities for community, collaboration, and networking—often across disciplinary 
lines. One member noted valuing the “collegial environment” and “intellectual engage¬ 
ment from a range of scholars” afforded by his/her institute, for instance, while another 
suggested that the primary benefit of his/her unit was the way in which it constitutes 
“a place to exchange ideas and be exposed to new perspectives.” In some cases, respon¬ 
dents indicated that these opportunities for community were especially valued in light 
of the lack of attention to teaching, learning, and SoTL in their home departments, and 
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the sense of loneliness or seclusion such disinterest can cause. As one participant put it, 
“[the centre] gives a community, support and focus to my research that I do not get in 
my home department” (Member). 

Other responses (31%) suggested that institute membership is also seen as beneficial 
for scholars insofar as it provides them access to a wide range of resources and supports 
that might not be available otherwise. These individuals valued opportunities to receive 
funding, administrative support, research assistants, and space for research through their 
units, for instance, as well as access to training opportunities and to consultants, experts, 
and mentors in the field. “Our Institute brings in amazing visiting researchers, as col¬ 
laborators and as presenters,” one member wrote, while another listed learning from col¬ 
leagues, access to literature, and the opportunity to apply for institute-specific grants as 
the primary benefits of belonging to a scholarship unit. Such responses suggest that these 
kinds of intellectual, practical, and material supports are central aspects of SoTL units’ 
ability to support enhanced educational scholarship. 

Six percent of participants responding to this open-ended question also suggested 
that their units served to increase the recognition and reputation of educational scholar¬ 
ship on their campuses, providing what one respondent referred to as institutional “le¬ 
gitimacy for research on teaching and learning” (Member). Nonetheless, there were also 
indications that there is still work to be done in this regard. One individual claimed, for 
instance, that his/her unit is “Starting to increase the acceptability of TL research at [the 
university], but only somewhat. TL research is still the poor cousin of discipline-based 
research outside of the School of Education” (Member). 

Finally, some respondents also suggested that their institutes have had a demonstrable 
impact on the quality of teaching and learning practices. For example, 16% claimed that 
the research generated by their institutes had resulted in enhanced teaching practices or 
policies on their campuses, while 6% claimed that their units contributed to improved 
student learning, retention, and/or success. While these claims demand substantiation via 
research examining actual teaching activities and student learning outcomes, they none¬ 
theless make clear that some institute participants believe their institute-sponsored work 
to be exerting a significant impact on educational quality at their institutions. 

Perceived challenges and shortcomings 

In spite of these benefits, respondents also described several challenges faced by their 
institutes. Alongside the widespread perception that the units investigated in this study 
helped to facilitate the building of vibrant scholarly communities, for example, the data 
also reflected a less common sense that these bodies did not always live up to their full po¬ 
tential in this regard. In response to an open-ended question about the main shortcomings 
of their institutes, for example, 7% of respondents specified that their centre generated 
limited communication or collaboration between scholars, a point that was also raised 
by 4% of respondents to an open-ended question about the main challenges people expe¬ 
rience as institute participants. One member cited a “Lack of deep and substance based 
collaboration” as a shortcoming, for instance, while another wrote that his/her centre 
“doesn’t try to bring together folks for research proposals that could explore broader top¬ 
ics and capitalize on collaborations.” At times, this limited collaboration was connected 
specifically to infrequent meetings and sporadic communication between members. As 
one respondent put it, “The institute is informal and the development group meets only 
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a few times each semester. It is difficult to carry on sustained conversations or develop 
collaborative projects” (Member). 

Just as some participants faulted their units for not generating sufficient collabora¬ 
tion between members, others (n=4) believed that their institutes were not sufficiently 
engaged in interdisciplinary inquiry. One member described his/her institute as “inter¬ 
disciplinary in name, but not really in practice,” while a director wrote that a central 
challenge is to “keep members motivated to become/stay involved in interdisciplinary 
research.” In other cases, respondents (n=8) acknowledged that their units are in fact ac¬ 
tive, multidisciplinary hubs, but suggested that this diversity of outlooks and approaches 
can itself be challenging to navigate. “With many diverse disciplines involved and many 
different focuses,” one member wrote, “it is sometimes difficult to get everyone moving 
in the same direction.” While the potential for interdisciplinary collaboration was widely 
positioned as a central benefit of the units examined in this study, the small number of 
participants describing challenges related to interdisciplinarity suggests that such cross- 
disciplinary work is neither a given nor an entirely unproblematic aspect of institute func¬ 
tioning. 

Limited resources were another oft-cited obstacle—one which was raised in 34% of 
responses to the question about shortcomings and in 12% of responses to the question 
about challenges experienced by institute members. In a typical response, one director 
wrote that the central issue plaguing his/her centre is a “Lack of people-power and other 
resources,” while another noted, “We have very little in the way of dedicated resources: 
time, money, and personnel.” In addition to a sense of general under-resourcing, the data 
also revealed indications that some participants believe the resources that their units are 
able to provide are not always sufficient. Amongst other complaints, for example, respon¬ 
dents reported shortcomings in institute support staff and SoTL training programs. These 
comments reiterate that many individuals perceive access to resources to be a primary 
benefit of institute membership, while simultaneously underlining that such benefits may 
be increasingly difficult for organized scholarship units to provide effectively in challeng¬ 
ing financial times. 

Like insufficient resources, a general lack of time for members to participate in unit 
activities was another challenge frequently attached to the educational scholarship bod¬ 
ies examined in this study. Echoing arguments about the increasingly complex nature of 
the demands on faculty time, 9% and 23% of responses to the two open-ended questions 
described above focused on what one member called a “Lack of time to conduct research 
projects due to other responsibilities.” Some reported that this challenge is exacerbated 
by the fact that institute participation is not fully recognized as part of their job duties, 
leaving them torn between unit activities and the requirements of their home depart¬ 
ments. As one individual noted, 

My current official job role also is ... at odds with participation in the 
institute, which has set frustrating limits on the ways in which I can con¬ 
tribute. It can feel like participation has to be on top of my official work. 

(Member) 

As this comment suggests, the perception that institute activities exist in tension with 
responsibilities to home departments can seriously threaten active participation in or¬ 
ganized scholarship units, particularly in view of how busy academic lives have become. 
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The possibility of SoTL work being sacrificed to other responsibilities is especially 
compelling given that many respondents, again echoing the literature, also reported that 
the type of scholarship in which their units engage is generally undervalued. Indeed, the 
relatively low esteem in which SoTL is held within research-intensive universities was po¬ 
sitioned by survey respondents as an especially prominent issue, being raised in 30% of all 
responses to the shortcomings question and 22% of responses to the membership chal¬ 
lenges question. Several participants claimed that colleagues in their home departments 
are uninterested in or do not respect SoTL work, for instance, while others argued that this 
undervaluing extends beyond their individual departments to the university as a whole. 

Finally, running alongside the more prevalent perception that the institutes examined 
in this study have a positive impact on teaching and learning, 13 respondents reported an 
opposing belief that their centres are either insufficiently influential or have not been sat¬ 
isfactorily assessed. One director suggested that his/her institute “directly impacts only 
the 15 or so fellows within [it],” for instance, while a member wrote that the unit with 
which s/he is affiliated “gives people something to think about, but doesn’t really change 
practice.” Such concerns, while comparatively infrequent in the data, nevertheless under¬ 
line the importance of planning carefully the ways in which scholarship conducted in an 
institute can be effectively translated into pedagogical practice. 

Institute design 

On another multiple-select question, participants indicated which of several re¬ 
sources and supports are offered by their institutes and ranked the importance of these 
features to achieving the unit’s goals (see Table 2). In spite of potential variability in other 
respects, most institutes represented in this data set appeared to offer a number of similar 
services and supports. Responses suggested that 90% of the features listed were available 
through at least 50% of respondents’ institutes. The most frequently provided features 
were regular meetings with other institute members (85%), workshops or courses on 
topics in teaching and learning research (83%), and consultation with knowledgeable 
research personnel (81%). 

Beyond indicating the most common attributes of the SoTL units included in this 
study, Table 2 also clarifies which of these features members perceive as particularly im¬ 
portant to their units’ success. Literature resources, grants, physical space for research, 
consultation with knowledgeable personnel, regular meetings with other institute mem¬ 
bers, the creation of targeted research groups, and workshops/courses on teaching and 
learning research topics stand out as especially significant. Each of these features was 
rated “very important” by at least half of the relevant participants. 

A subsequent question, which asked participants to indicate which of the factors listed 
in Table 2 is most important to their institute’s ability to foster educational scholarship, 
yielded similar results. Grants were the most frequently selected response (29%), and 
regular meetings, targeted research groups, consultation with experts, and workshops or 
courses were selected by 11% to 7% of respondents each. Perhaps not surprisingly, these 
attributes overlap strongly with some of the primary benefits participants connected to 
institute membership in other survey questions, insofar as they include activities that en¬ 
courage the creation of community and collaborative scholarship (regular meetings, tar¬ 
geted research groups), and examples of resources available to members (grants, training 
and mentorship opportunities). As such, these responses reaffirm some of the advantages 
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Table 2. Institute Features and Their Perceived Importance 


O 


NUMBER OF RESPONSES BY RANKING 


INSTITUTE FEATURE 

NUMBER OF 

RESPONSES 

NOT OFFERED 

BY MY 

INSTITUTE 

OFFERED & 

UNIMPORTANT 

OFFERED & 

SOMEWHAT 

IMPORTANT 

OFFERED 

& VERY 

IMPORTANT 

Library/literature resources 

164 

48 

12 

32 

72 

Grants/seed money for 
research 

163 

51 

3 

45 

64 

Physical space for research 

168 

81 

10 

28 

49 

Consultation with knowl¬ 
edgeable research personnel 

158 

30 

7 

53 

68 

Regular meetings with other 
institute members 

157 

23 

11 

54 

69 

Creation of targeted 
research groups 

148 

50 

10 

39 

49 

Workshops/courses on 
teaching & learning research 

163 

27 

12 

56 

68 

Grant writing support 

158 

70 

10 

35 

43 

Research Assistants 

152 

95 

7 

23 

27 

Fellowships for grad 
students/post-doctoral 
researchers 

150 

69 

9 

34 

38 

Administrative support 

162 

63 

9 

45 

45 

Research tools & technology 

164 

47 

8 

56 

53 

Support for integrating 
research into teaching 
practice 

155 

58 

16 

38 

43 

Technology support 

167 

57 

14 

48 

48 

Institute-sponsored visiting 
scholars 

151 

49 

15 

43 

44 

Opportunities to lead 
courses/workshops on 

SoTL issues 

153 

41 

15 

53 

44 

Access to institutional data 

142 

68 

15 

30 

29 

On campus conferences/ 
symposia 

156 

31 

9 

68 

48 

Electronic communication 
platform for resource sharing 

160 

46 

20 

54 

40 

Institute-sponsored retreats 

152 

92 

14 

26 

20 

Publicity for research 
activities (e.g., campus 
newsletter) 

158 

32 

26 

61 

39 


27 
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participating members attribute to their SoTL units, and further specify design features 
considered to be important means of securing them. 

DISCUSSION 

The study reported here contributes to an enhanced understanding of the ways in 
which educational scholarship institutes are organized and structured at research-intensive 
universities worldwide. It also identifies a number of central benefits and challenges at¬ 
tached to such entities, as perceived by a portion of the scholars who populate them. 
Many of the findings, including the potential for institutes to encourage collaboration, 
community, and interdisciplinarity, the ways in which they can provide academics with 
valued resources and capacity-building opportunities, and the extent to which they are 
challenged by scholar workload and by the undervaluing of SoTL in institutions and de¬ 
partments, corroborate and extend arguments made in the scholarship of teaching and 
learning and organized research unit literatures. At the same time, this research also sug¬ 
gests new considerations, such as a sense that some of the most common institute features 
(e.g., publicity for research, conferences), while still seen as relatively important, may not 
be the elements valued most by institute participants. Perhaps foremost amongst the pro¬ 
vocative ideas prompted by the data is the notion that, for many individuals, educational 
scholarship units can be marred by insufficient collaboration and communication. While 
not surprising on one hand, this rarely discussed issue emphasizes that the community, 
collegiality, and interdisciplinarity that are seen as hallmarks of such units are neither 
simple to achieve nor assured. Rather, these must be actively planned for and fostered, 
just as they must in other contexts. 

As a whole, these preliminary findings highlight a number of considerations that 
might be brought to bear on the design of organized SoTL institutes. While the pilot na¬ 
ture of the study suggests that care should be taken when building recommendations from 
the data, the fact that many of the suggestions arising from the present research are well 
supported in the SoTL literature provides further support for their legitimacy. Indeed, 
one of the most striking outcomes of this study is the fact that it largely corroborates 
much of what is already known about developing SoTL, thereby suggesting that many of 
these established principles continue to apply within the particular context of organized 
research institutes. While such institutes might have a number of benefits, then, they 
are clearly not ‘magic bullets’ in terms of supporting and institutionalizing teaching and 
learning inquiry, and existing knowledge about these issues should be meaningfully de¬ 
ployed in order to help institutes meet their full potential. This study aids in this process 
by pointing toward specific elements of the extant literature that might be most important 
to consider when engaging in institute design. Several of these are summarized below. 

Developing priority areas for institute scholarship 

In the present survey, respondents positioned the creation of research groups around 
targeted areas of interest as one of the design features most significant to their institutes’ 
successes. This finding resonates productively with literature that suggests the value of 
aligning SoTL with established priorities of the institution, on one hand (Schroeder, 
2007), and of individual departments and disciplines on the other (Dewar & Bennett, 
2010). Targeted research groups might be established around priority questions at each 
of these levels. 
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On a similar note, Poole et al. (2007) argue that much of the promise of institutes 
lies in their capacity to provide centralized infrastructure for inquiry addressing institu¬ 
tional concerns. This study offers preliminary support for this assertion, as 72% of indi¬ 
viduals (Table 1) claimed that they have contributed to meeting their universities’ cen¬ 
tral priorities as a result of participating in their institutes. Finding ways to additionally 
marry unit scholarship to disciplinary priorities, perhaps drawing from approaches such 
as those described by Cousin et al. (2003), would likely also prove beneficial, particu¬ 
larly insofar as this could contribute to shifting departmental cultures that are currently 
unreceptive to such work. 

Of course, department-driven research should not be pursued to the detriment of 
work that transcends disciplinary boundaries. In fact, several writers have suggested that 
discipline-focused approaches to SoTL can and should co-exist alongside opportunities 
for interdisciplinary work and exchange (e.g., Fanghanel, 2013; McKinney, 2013). Like¬ 
wise, respondents to the present survey, echoing the literature about organized research 
institutes in other fields (Sa, 2007), emphasized the benefits of communicating with in¬ 
dividuals across departmental boundaries and engaging in interdisciplinary research via 
their institutes. To this end, the priority areas established for institute scholarship might 
intentionally and strategically include interdisciplinary inquiry in addition to address¬ 
ing disciplinary priorities. Such a dual focus would also respond to the concern, likewise 
raised in this survey, that scholarship in some institutes is not sufficiently interdisciplinary 
or collaborative. 

Building a diverse institute community 

Perhaps the most pronounced theme emerging from the present research was the 
potential for an institute to contribute to developing a vibrant and collaborative com¬ 
munity around SoTL work. Corroborating claims about centralized SoTL initiatives in 
the literature (Hubball et ah, 2010), nearly 40% of participants describing the benefits of 
their institutes in this study mentioned the way in which membership permitted them to 
work with a broad network of colleagues they might not otherwise meet. Likewise, when 
such community was perceived to be lacking, survey respondents noted this as a primary 
shortcoming. As such, this research underlines that a large, diverse, and collegial institute 
community may be both vital for success and challenging to foster. 

As part of this process, a primary task for any SoTL institute will be to engage a wide 
range of participants and encourage meaningful collaboration amongst them. In order to 
emphasize that SoTL is potentially valid work for all academics (Shulman, 2011), and thus 
to combat the sense that it is not "real” scholarship (Chalmers, 2011), faculty participants 
should ideally be drawn from across disciplines, represent a variety of career stages, and 
include those known as high-level scholars in their fields (Becker, 2008). Based on the 
present data, it might also prove productive to develop joint faculty appointments with 
responsibilities to the institute and to a department on campus. In light of the complex 
demands on faculty time, such appointments would create occasions wherein institute 
work is an official part of scholars’ job responsibilities with time allotted to it, thereby 
minimizing the under-prioritizing reported in this study and elsewhere. Again pulling 
from recommendations in the broader SoTL literature, educational developers should 
likewise be included wherever practicable (Patel, 2014), as should undergraduate and 
graduate students (Felten, 2013; Healey, Flint, & Harrington, 2014). Extending this net- 
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work of participants beyond the institutional context might also prove valuable, providing 
an augmented sense of community for institute scholars (Simmons et al., 2013), and si¬ 
multaneously enhancing the regard in which the institute and its work are held by virtue 
of external validation (Ginsberg & Bernstein, 2011). 

Of course, more than simply deploying these proposed strategies to assemble a di¬ 
verse array of people, care must be taken to foster meaningful connections amongst mem¬ 
bers of this group. Reflecting the survey finding that regular meetings of institute members 
is both a common feature of the units studied and one perceived as especially important 
to their success, a number of opportunities should be planned for scholars affiliated with 
an institute to work together actively and collaboratively. Well documented approaches 
like learning communities (Richlin & Cox, 2004) could be deployed to this end, for in¬ 
stance, as might strategic uses of grants to foster collaborative, interdisciplinary research 
(McKinney & Jarvis, 2009). 

As part of this plan for ensuring meaningful and effective connections amongst in¬ 
stitute scholars, attention should also be paid to the challenges that can attach to work¬ 
ing across disciplinary lines. As Huber (2013)—like several participants in this study— 
explains, “leaving one’s disciplinary home is worthwhile, but it can also be really hard” 
(p. xiii). In order to help institute members through this process, multi-disciplinary teams 
might be encouraged to discuss and come to common understandings of relevant terms 
(Poole, 2013), and should include mentors who are experienced in interdisciplinary 
work wherever possible (Meta Robinson et ah, 2013). Given that interdisciplinarity and 
diversity have been positioned as key elements of educational scholarship institutes and 
of SoTL more broadly, building such recommendations into support for institute mem¬ 
bers may well be key to such bodies’ success. 

Providing meaningful resources, incentives, and PD opportunities 

Like the development of community, access to resources has been named frequently 
as an essential feature of organized scholarship units. In the present study, over 30% of 
respondents describing the benefits of their institutes mentioned funds, professional 
development opportunities, and/or other resources as especially valued and valuable, 
confirming claims reported in the literature pertaining to research centres in other fields 
(Boardman & Bozeman, 2007; Sa & Oleksiyenko, 2011). With this in mind, it seems cru¬ 
cial for SoTL institutes to provide access to meaningful resources and incentives if they 
are to attract and retain the diverse body of scholars called for above. 

Moderate grants might be provided for members, for instance, especially considering 
that such funds are now a fairly common offering (Mackenzie & Mann, 2009) and that 
they were the feature most frequently selected as most important to an institute’s success 
in this survey. At the same time, SoTL institutes might also offer members access to pro¬ 
fessional development opportunities that will help them advance as SoTL scholars. Not 
surprisingly, given the oft-described challenges of developing a SoTL identity and the 
potentially unsettling feelings that can attach to this process (Tremonte, 2011), consulta¬ 
tions with knowledgeable research personnel and workshops or courses on teaching and 
learning research topics were both labeled “very important” by at least 50% of survey par¬ 
ticipants who noted that their institutes provided such supports. At the same time, some 
published work (Donnermeyer, Kalish, & Johnson, 2009) suggests that workshops do 
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not always attract participants, nor engage individuals who do take part as extensively and 
meaningfully as would be ideal. To that end, alternative models of professional develop¬ 
ment might also be explored, such as the faculty learning communities (Richlin & Cox, 
2004) referred to above and other collaborative and cohort-based programs described 
in the literature (e.g., Hubball et al., 2010; Marquis, Healey, & Vine, 2014). Significantly, 
these alternate models would also provide additional opportunities for community build¬ 
ing and mentorship, and thus further assist in creating the collaborative environment re¬ 
quired for a successful and productive institute. 

Developing a sustainable funding plan 

It goes without saying that considerable financial resources would be required to 
implement many of the recommendations advanced thus far. While it certainly might 
not be possible to provide for all of these suggestions in all cases, it is not unreasonable 
to propose that a number of them must be realized if SoTL institutes are going to deliver 
on their promise. Indeed, the most common shortcoming that participants in this study 
attributed to the units with which they are affiliated was a lack of money and other re¬ 
sources, which many saw as impinging considerably on what their institutes were able to 
accomplish. To that end, it may well be imperative that sufficient, long-term funding is 
acquired to support SoTL institutes and their work. 

It should be underlined that requiring such institutes to support themselves via the 
acquisition of grant funds is not a sustainable plan, particularly since, as one survey par¬ 
ticipant put it, “education research does not bring big research funding” (Member). More¬ 
over, existing literature about research institutes suggests this type of structure can also 
have negative impacts on institute scholarship, requiring members to devote substantial 
amounts of time to fundraising or to conducting projects that might suit grantors but 
deviate from their own or the institute’s focus areas (Sa & Oleksiyenko, 2011). While 
members and staff might certainly pursue grant opportunities actively, institute budgets 
must not finally be dependent on such funds. 

CONCLUSION: FINDINGS FROM —AND QUESTIONS FOR —RESEARCH 

Like all research, the present study is not without its limitations. Given that it was 
focused largely on participants’ self-reported experiences within teaching and learning 
scholarship institutes, it did not directly assess the benefits, challenges, and impacts of 
such bodies. Moreover, a volunteer bias may be present, since participants self-selected 
to take part in the research. The relatively low response rate also means that data were not 
collected from people affiliated with many of the institutes, limiting generalizability, and 
that meaningful correlations between design features and perceived benefits/challenges 
could not be calculated. It should also be recalled that a broad definition of‘educational 
scholarship institute’ was used in selecting units for the study. This might also be con¬ 
strued as a limitation, insofar as it brings together a diverse range of units under one label. 
Future research might consider adopting a more precise classification system that would 
allow for greater generalization. 

Nevertheless, taken as a pilot, the present study provides several preliminary insights 
directly relevant to the research goals and provokes a number of significant considera¬ 
tions that might be explored fruitfully in the future (perhaps using other approaches, such 
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as Delphi techniques or in-depth case studies). It makes clear its participants’ reported 
perceptions of the institutes in which they work and underlines shared views (amongst 
many taking part) of benefits, challenges, and impacts regardless of potential differences 
in unit type. Ironically, perhaps its most compelling finding is that it finds little new. In¬ 
sofar as the issues described here in relation to SoTL institutes resonate closely with lit¬ 
erature discussing SoTL broadly, the survey points to the relevance of bringing this larger 
scholarly context to bear on questions of institute design—a task I attempted to initiate 
in the recommendations provided above. While this process seems likely to have tangible 
benefits for those developing or working within SoTL research centres, the sheer famili¬ 
arity of the findings also perhaps underscores the need for us, as scholars interested in 
developing and institutionalizing SoTL, to ask different kinds of research questions, in 
different ways, moving forward. 

Potential international differences in fostering and supporting SoTL, for example, 
which the present survey could not unpack due to its anonymous nature and limited 
demographic questions, represent one such issue that demands further exploration. As 
Hoon and Looker (2013) point out, SoTL has developed largely as a Western, English- 
speaking field, and thus has frequently excluded a number of voices from around the world. 
In the present study, familiar themes were found across a body of data drawn from inter¬ 
national participants, but it remains to be seen whether the predominance of these ideas 
was based on their ‘universal’ nature or simply on the fact that more people from Western 
countries participated. Research that more fully unpacks the extent to which issues well 
known in the SoTL literature translate to non-Western contexts would be beneficial to 
our understanding of the development of teaching and learning inquiry in institutes and 
beyond, even as it works to open the field to a wider range of voices. 

As noted by a reviewer of an earlier version of this manuscript, the familiarity of the 
findings reported here might also be taken as an indication of the need to consider not 
only how SoTL work is facilitated, but why scholars might wish to engage this type of 
work in the first place. In order to supplement explorations of experiences and impact, 
we might begin to turn to questions of scholar motivation and expectations, comparing 
these in turn to reported perceptions of benefit and challenge. Theoretical conceptions 
like Akerlind’s (2008) model of‘being a researcher’—a framework that describes quali¬ 
tatively different conceptions amongst scholars of the nature and purpose of research— 
could inform such work productively. The notion of substantive differences in what indi¬ 
viduals make of scholarship (in this case SoTL) stands to generate interesting questions 
about how we might best support scholars with differing understandings, and perhaps 
about the practicalities and ethics of establishing institutes and other SoTL initiatives 
that favour particular conceptions over others. Indeed, further theoretical grounding of 
studies connected to SoTL development would be beneficial more generally, particularly 
if scholars were to begin to draw from a broad range of approaches that might comple¬ 
ment and extend useful socio-cultural models now relatively common to research in this 
area (e.g., Martensson et al., 2011; Williams et ah, 2013). While the findings reported 
here are useful in corroborating the literature and indicating that it might be soundly 
applied to a specific and growing context, then, they are perhaps especially provocative 
for how their very sameness might push scholars of SoTL development to broaden the 
boundaries of our work. 
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NOTES 

1. Throughout this article, I also refer to such entities as SoTL/educational/teaching and 
learning scholarship units or research centres in order to avoid repetitive word choice. 
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